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DETAILED ACTION 
SpecMcati'on 

1 . The disclosure is objected to because of the following informalities: 

(a) Paragraph [0013] on page 3 of 18 of the specification recites "Fig. 1 is a lock diagram generally 
showing an image processing system that can programmed 

Suggested correction: Insert "be" in front of "programmed". 

After correction: "Fig. 1 is a lock diagram generally showing an image processing system that can 
be programmed ". 

(b) Lines 5-6 of the paragraph [0021] on page 4 of 18 of the specification recites "The post 
processor 14 may comprise. . ..". 

Figure 1 discloses post processor as element 24. The cited specification is not consistent with 
drawings. 

Suggested correction: Change post-processor element nvimber 14 to number 24 in the cited 
specification of para. [0021]. 

(c) Line 4 of the paragraph [0027] on page 6 of 18 of the specification recites "The result is the 
processed image 36 with aU annotations intact. . .. ". 

Figure 1 discloses processed image as element 26. The cited specification is not consistent with 
drawings. 
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Suggested correction: Change processed image element number 36 to number 26 in the cited 
specification of para. [0027]. 

Appropriate correction is required. 

Claim Rejections - 35 USC§ 102 

2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a ptinted publication in this or a foreign country or in public use or on sale in 
this country, more than one year prior to the date of application for patent in the United States. 

3. Claims 1, 13 and 30 are rejected \mder 35 U.S.C. 102(b) as being anticipated by Ikeshoji et 
al, U.S. Patent No. 5,761,339. 

Regarding claims 1, 13 and 30, Ikeshoji discloses removing one or more annotations form 
a grayscale annotated image to derive a first modified image (figure 1; element 20D being the first 
modified image, which is obtained after annotations (elements 30, 32 and 34) are removed; element 
30D represents removed annotations only with no background image). 

Ikeshoji further discloses processing said first modified image (20D) using an algorithm to 
derive a processed image (col. 5, lines 1-5; removing stains). 

Ikeshoji further discloses merging the removed one or more annotations with said processed 
image to derive a merged image (figure 3, element 10-1 being the merged image). 
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Claim Refections - 35 USC§ 103 

4. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 
rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this tide, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary 
skill in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claims 2-12, 14-21 and 31-32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ikeshoji et al., U.S. Patent No. 5,761,339, further in view of Macleod et al., U.S. Patent No. 
5,778,092, and further in view of Bloomberg, U.S. Patent No. 5,065,437. 

Claim 2 recites "The method as recited in claim 1, wherein said removing step comprises 
the following: deriving a first binary mask defining one or more image regions; and mxiltiplying said 
first binary mask and said annotated image to derive said first modified image". Ikeshoji clearly 
teaches in figure 1, deriving a first modified image (element 20 D) firom which annotations have 
been removed with the help of filtering (or masking). Removing a part of images by using a mask is 
very well known in the process of image segmentation where processing such as convolution further 
involving multiplying mask bits with original image is used and is generally used in differentiating 
and removing an image part from the original image. Ikeshoji does teach of using a filter or mask 
but does not specifically teach deriving a binary mask, however, Macleod teaches this generally used 
well-known method of deriving a binary mask (col. 2, lines 1-13; col. 4, lines 65-68 through col. 5, 
lines 1-16 and lines 30-68; col. 8, lines 4-10 and lines 25-40). 

Further supporting, in lines 57-62 of col. 11, MacLeod discloses that U.S. Patent No. 5,065,437, is 
incorporated by reference, thereby, not requiring the motivation to combine the references. 
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Bloomberg. Bloomberg provides the support for subject matter in claim 2 in (figure lB,coL 2, lines 
20-68; coL 4, lines 1-68; col. 6, lines 10-40). Therefore, it would have been obvious for one of 
ordinary skill in the art at the time of invention was made to use combined teachings of MacLeod 
and Bloomberg in the invention of Ikeshoji because all references are directed to image 
segmentation and the combined MacLeod and Bloomberg's teachings provide the well-known 
teachings that are generally used in image segmentation, which would further provide a robust and 
computationally efficient technique for identifying and separating regions (See Bloomberg, col. 2, 
lines 5-15). 

Claim 3 recites "The method as recited in claim 2, wherein said merging step comprises the 
following" inverting said first binary mask to derive a second binary mask defining one or more 
annotation regions; multiplying said second binary mask and annotated image to derive a second 
modified image; and merging said second modified image and said processed image to derive said 
merged image". Ikeshoji clearly shows in figure 1, deriving images 20D and 30D, where in image 
20D annotations are removed and in image 30D only annotations are present, therefore these 2 
images are clearly subject to the apparent use of a mask that when inverted would provide 
segmentation for extracting one part or the other from the original image. Figure 3 clearly shows 
merging said second modified image (30) and said processed image (20) to derive said merged image. 

Claim 4 recites "The method as recited in claim 1, wherein the merged annotations occupy 
the same pixels in said merged image that the removed annotations originally occupied in said 
annotated image". Ikeshoji clearly shows in figure 3 the image 10-1 which has annotation at the 



Application/Control Number: 10/064,873 Page 6 

Art Unit: 2625 

same image position as shown in figure 1 image 10 and further support can be found in (col. 4, lines 
6-12). 

Claim 5 recites "the method as recited in claim 1, wherein said removing step comprises 
morphology-based processing and thresholding'\ MacLeod discloses dilation and erosion 
(morphological operations) (col. 7) and further teaches thresholding (col. 5). 

Claim 6 recites "The method as recited in claim 1, wherein said removing step comprising 
the following: grayscale erosion of said annotated image using a structuring element to derive an 
eroded image; thresholding said eroded image to derive a first binary mask; dilation of said first 
binary mask using said structuring element to derive a second binary mask defining one or more 
image regions; and mxiltiplying said second binary mask and said annotated image to derive said first 
modified image". The subject matter recited in the claim 6 is nothing but a morphological operation 
(opening: erosion followed by dilation), which is very well-known to be used in the process of 
identifying and separating image portions. MacLeod clearly teaches all the steps recited in claim 6 in 
(col. 11 through col. 12, lines 1-55). Bloomberg further provides the support in (col. 9, lines 45-68 
dirough col. 10, lines 1-25). 

Regarding claim 7, citing the well-known fact of modifying the image using an image mask, 
and in further view of Ikeshoji providing merging of images as explained before in the rejection of 
claim 3. Claim 7 has been similarly analyzed and rejected as per claims 3 and 6. 
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Regarding claim 8, MacLeod discloses said removing step comprises thresholding and 
pixel connectivity-based analysis" (col. 6, lines 44-56). See Bloomberg (col. 2, lines 28-60; col. 4, lines 
40-65; col. 7, lines 1-65). 

Regarding claim 9, claim 9 additionally recites the limitation where "using 8-connected 
analysis to reject segments smaller than a prespecified size £com said first binary mask to 
derive a second binary mask". MacLeod discloses of the same in (col. 6, lines 44-56; col. 10, lines 1- 
40). All other limitations have been similarly analyzed and rejected as per claims 1-8. 

Regarding claim 10, claim 10 has been similarly analyzed and rejected as per claims 9, 7 and 

3. 

Regarding claim 11, claim 1 1 in addition to claim 9 recites "removing holes from a second 
binary mask to derive a third binary mask". MacLeod teaches mask reconstruction for filling 
(removing) the interior holes (col. 11, lines 63-68 through col. 12, lines 1-15). 

Regarding claim 12, Ikeshoji discloses filtering to enhance said first modified image (coL 6, 
lines 10-20). 

Claims 14-21 have been similarly analyzed and rejected as per claims 2-12. 



Claim 31 and 32 have been similarly analyzed and rejected as per claims 2-3. 
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6. Claims 22-29 are rejected under 35 U.S.C. 103(a) as being unpatentable over Ikeshoji et al., 
U.S. Patent No. 5,761,339, further in view of Macleod et al., U.S. Patent No. 5,778,092, and further 
in view of Bloomberg, U.S. Patent No. 5,065,437 and further in view of Gonzales et al., 1992, Book 
publication "Digital image processing". 

As discussed before in the rejection of claims 1-12, the combined invention of Ikeshoji, 
MacLeod and Bloomberg provides techniques that are used on grayscale images. Now the question 
is, can the same techniques be used on color images? The answer would be yes and further support 
is provided by Gonzales. Gonzales teaches "the HIS model is ideally sviited for image enhancement, 
because the intensity component is decoupled from the color information in an image. Therefore 
any monochrome enhancement technique can be carried over as a tool for enhancing full-color 
images. It simply calls for converting the image to the HIS format, processing the intensity 
component, and converting the result to RGB for display" (page 247, 4* paragraph) and apparendy 
the HS components would have to be merged back in as the processing is done on color images and 
the output required would be a color image. Also, converting an RGB to HSI and HSI to RGB 
model is very well known and is further taught by Gonzales on page 229 and 235. Therefore, 
providing a motivation for one of ordinary skill in the art at the time of invention was made to 
combine Gonzales's teachings in the combined invention of Ikeshoji, MacLeod and Bloomberg. All 
other limitations of claims 22 and 26 have been similarly analyzed and rejected as per claims 1-12. 

Claims 23-24 and 27-28 have been similarly analyzed and rejected as per claims 2-3, 22 and 

26. 



Claims 25 and 29 have been similarly analyzed and rejected as per claims 22 and 26. 



Application/Control Number: 10/064.873 Page 9 

Art Unit: 2625 

Conclusion 



7. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

• Bloomberg, U.S. Patent No. 5,181,255, discloses segmentation of handwriting and 
machine printed text. 

• Bloomberg, U.S. Patent No. 5,202,933, discloses segmentation of text and graphics. 

• Itonori et al., U.S. Patent No. 5,386,508, discloses character/ figure separating 
device. 

• Smith, U.S. Patent No. 4,856,075, discloses image discrimination. 

• Greenly, U.S. Patent No. 3,496,543. 

• Ohuchi et al., U.S. Patent No. 5,617,485, discloses image region segmentation 
system. 

• Khorram, U.S. Patent No. 6,175,425. 

Any inquiry concerning this communication or earlier communications firom the examiner 
should be directed to Manav Seth whose telephone number is (571) 272-7456. The examiner can 
normally be reached on Monday to Friday from 8:30 am to 5:00 pm. 



If attempts to reach the examiner by telephone are imsuccessful, the examiner*s supervisor, 
Bhavesh Mehta, can be reached on (571) 272-7453. The fax phone number for the organization 
where this application or proceeding is assigned is 571-273-8300. 
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Infottnation regarding the status of an application may be obtained firom the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained ftom either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR system, 
see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR system, 
contact the Electronic Business Center (EBC) at 866-217-9197 (toU-ftee). 




Manav Seth 
Art Unit 2625 
December 21, 2005 
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